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ABSTRACT 


The filter design problem is considered as an optimization problem. 
An iterative search technique is employed to adjust the variable net- 
work element values to approximate some desired network response, with 
a minimum of error. Explicit constraints are employed to ensure 
physical realizability. The design process uses a combination of a 
modified version of Calahan's network ana ee program with a direct 
search method of minimization developed by Hooke and Jeeves. The 
result is a procedure which utilizes the circuit designer's experience 
and knowledge to set up the problem but relieves him of the tedious 


labor now performed by the high-speed digital computer. 
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I. INTRODUCTION 


A. COMPUTER-AIDED NETWORK DESIGN 

Mathematical programming techniques have found wide use in operations 
research, economics, and other related fields. However, it has only been 
in recent years that such techniques have gained acceptance as tools for 
the design and evaluation of electronic circuits. The development of 
several general network-analysis programs has made computer-aided net- 
work design quite attractive. What is computer-aided network design? 
The circuit operation is first analyzed by means of a computer. It is 
then modified and analyzed again until the desired result is achieved--a 
trial-and-error procedure. Naturally the more experienced the engineer, 
the fewer the trials before a satisfactory design is realized. 

The engineer today has a variety of analysis programs which may 
suit his needs in the design of networks. Some of the more well-known 
ones are: NET-1, ECAP, SCEPTRE, NASAP, CIRCUS, LISA, PANE, CALAHAN, 
and CORNAP. Programs such as these have offered great assistance to 
the engineer in the analysis and design of networks. Although the 
obvious advantages in saving of time and tedious labor are quite 
Apparent, there are certain features that would be desirable and 
perhaps possible in future programs of the type mentioned. Some of 
these features may include: 

1. A graphical output on remote terminals which will allow the 
engineer to check his results and make on the spot changes as necessary. 

2. Automatic means for improving the circuit design; i.e., some 


optimization technique to obtain "best'' element values. 


As valuable an aid as the computer is, a significant part of the 
design ee eee still require the engineering judgement of the 
designer. The cost for relieving the engineer of all the tedious calcu- 
lations required for analysis is not an inexpensive one. The engineer 
must use his knowledge to specify the network topology, the response 


desired, constraints on element values, error criteria, reasonable 


initial element values, and other information which only he can provide. 


B. USE OF OPTIMIZATION TECHNIQUES IN COMPUTER-AIDED NETWORK DESIGN 

The network designer is basically confronted with the problem of 
designing a circuit to meet some prescribed performance requirements. 
The design may be accomplished in one of many ways. If the requirements 
are such that an existing synthesis technique will provide the answer, 
the problem is essentially solved, and a satisfactory solution is obtained. 
In some cases a perfectly good design may be achieved in the laboratory 
“by physically wiring the circuit on the "bread-board" and experimentally 
determining the "best'' element values for the design. 

There are classical synthesis techniques which provide a step-by- 
step design procedure, resulting in the circuit configuration and 
element values [1]. However, there are some design problems which may 
not be amenable to solution by any of the known synthesis techniques. 
The designer may be given a requirement in the form of a table of values 
or a graph of the response desired. Such a requirement cannot " satis- 
fied by the classical synthesis techniques. If the circuit contains a 
large number of variable elements, design by a trial-and-error process 
‘ig the laboratory is also highly unfeasible. Again, as with the analysis, 


the high-speed digital computer has offered an alternative approach to 





the problem. We can now use some optimization technique to find element 
values in a given design configuration which yield a solution nearest 

to the Stiscoxnped performance requirement. The optimization technique 
iteratively adjusts the element values until the requirement is approxi- 
mated as closely as possible. 

Although synthesis techniques are available for the design of 
standard high- and low-pass filters, they do not take into account any 
constraints on the network configuration or element values. Problems 
of this nature would certainly be amenable to solution by an optimi- 
zation technique. Networks whose transfer functions are extremely 
complex comprise another class of problems which could be solved by 
Optimization. Optimization may also be used to obtain models for active 
devices. An optimization scheme could well be used in the design of 
matched filters. There are countless other examples, but suffice it to 
say that a Sone oe tion of a good network analysis program and an 
efficient optimization program is certainly an excellent application 


of computer-aided network design. 


C, OPTIMIZATION TECHNIQUES 

In any optimization procedure two requirements must be satisfied. 
First, there must be some means to determine the behavior or performance 
of the system for any set of parameter values, Second, a performance 
measure must be selected which is a numerical measure of the behavior 
of the system. The optimization is basically a matter of minimizing 
the performance measure, which is a function of the parameters. If we 
think of this in geometric terms, the points in the parameter space 


represent different circuit element values and any change in the element 


value will result in movement to another point in the space. The per- 
formance meaictice is defined on this parameter space and requires an 
additional dimension if it is to be represented geometrically. 

Minimization techniques generally do not yield the global minimum. 
What is found is a local minimum, but by changing the starting values 
of the parameters, it can be determined whether the local minimum is 
also the global minimum. If the minimization procedure converges to 
different vaueee os the performance measure, the smallest value of the 
performance measure is then selected as the global minimum. The dif- 
ferent minimization techniques may be classified by the method which 
is utilized to find a local minimum. They may be generally classified 
in the three following categories: 

1. Direct search methods: those which do not compute the partial 
derivatives of ame performance measure with respect to the parameters, 
but use only the value of the performance measure. 

2. Gradient methods: those which require the calculation of the 
first partial derivatives of the performance measure with respect to 
the parameters. 

3. Second-Order methods; those requiring higher-order partial 
daPivatinCee” 

No attempt will be made here to discuss the various methods under 


each category. An excellent discussion of the methods can be found in 


Ref. ee 


D. THE GENERAL NATURE OF THE PROBLEM 
Earlier it was stated that for problems which cannot be solved by 
existing synthesis techniques or by experimenting with the circuit, an 


Optimization technique may be feasible as an alternative solution. 
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Problems which are amenable to solution by optimization will generally 
be stated as follows: "Given a particular network with a fixed number 
of variable elements, adjust these elements until the response of the 


~~ = 


network minimizes some preassigned criterion". The key words in this 


general statement are " 


particular network with a fixed number of vari- 
able elements". For a particular desired response there may be several 
network configurations which will yield comparable results. The job of 
the designer then is to choose among the configurations he tries, and 
to select the best design which satisfies the requirements. One of the 
desirable features the engineer would like in future programs for com- 
puter-aided design is the ability of the program to also produce the 
network Son cd evra on as well as the element values for the optimal 
network for a given response. With the existing programs the engineer 
starts with a particular network configuration and a fixed number of 
variable elements are adjusted until the performance meets some pre- 
assigned criterion. 

Now that ‘ho ee of design problem is defined, the important 
features of the optimization process may be studied. Figure I-l 
gives the essential elements which should be a part of the optimization 
technique for the circuit design problems. 

The choice of the network configuration and the initial element 
values is the task of the engineer before the actual optimization 
process begins. The features to be discussed now are the evaluation 
of the response, the performance measure and the decision-making 
process. 


The first thing the optimization program must be capable of doing 


is to evaluate the response from a given set of element values. This 
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Fig. I-l The Optimization Process 


must be done each time the element values are adjusted. The analysis 


programs mentioned above all have this capability. 


Once the response has been evaluated, it must be compared with the 


desired response. 


The measure of behavior is the performance measure. 


It is impossible to choose a single criterion and call it the universal 


performance measure. The nature of the problem may determine what per- 


formance measure is to be used. The experienced circuit designer will 


generally have in mind what performance measure is best for a given 


situation. The performance measure chosen must remain the same throughout 
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the design procedure. Some problems will dictate what performance 


measure is to be used, but in many cases the choice is purely subjective 
[3>): 

There are several typical forms of the performance measure the 
designer may use in the optimization process. The simplest form would 
be 

N 
“2 lig 1 gre age) 
i=1 
where J(p) is the performance measure, a function of the parameter 
values p> the terms Ry (£5) and Ry (f.) represent the actual and desired 
frequency responses, respectively, and N is the total number of points. 
This form of the performance measure indicates that only the magnitude 


of the difference is of interest, positive and negative deviations 


having equal weight. Another performance measure is 


N n 
ha a Ry ep E.)| 
i=l 


where n is some even integer. When the difference between the actual 
and desired responses are small, say less than 1.0, then the value of 
this performance measure will decrease with increasing values of the 
exponent, n. These are just two examples of what may be used for 
performance measures. By defining the performance measure in some way 
such as mentioned above, the optimization procedure is one in which a 
search is conducted to find the minimum of the performance measure. 
The search for this minimum generally results in finding a local 
minimum as mentioned above. Only if it is known that the function is 
unimodal will the local minimum be the global minimum. Otherwise, it 
is necessary to conduct a systematic search of the entire parameter 


- 


i 


space in order to locate the global minimum. For problems that have 
more than three or four variable parameters this may not be feasible. 
However, if the search is started with new initial values of the 
elements, and the function value converges to the same value, then one 
can be relatively certain that a global minimum has been located. By 
finding a minimum, whether it be local or global, a perfectly acceptable 
solution may be obtained. In the final analysis, it is the engineer's 
decision whether the final network configuration behaves ina satis- 
factory manner or whether further investigation is necessary to locate 

a "better" minimum. 

This final ee the decision of the engineer, is perhaps the most 
critical item in the optimization. He must weigh the cost of further 
exploration to find a smaller minimum against the solution he already 
has. A great deal depends on what the circuit requirements are. The 
tolerances on the element values may be such that the procedure may 
have to be repeated again and again. On the other hand, there may be 
very weak en nee on the element values so long as the response 
matches the desired response within say 0.1%. The computer relieves 
the engineer of the tedious work involved in any optimization procedure, 
but he is still responsible for making the knowledgable decisions to 


use the computer most advantageously. 
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It. THE OPTIMIZATION PROGRAM 


A. ANALYSIS PROGRAM 

As Reaction’ Wn Chapter I, the optimization procedures will 
include an analysis program and a minimization program. Among the 
various programs available, the CALAHAN and ECAP programs were con- 
Sidered as likely choices. Both programs were subjects of study in 
a course in computer-aided design, taught by Professor S. G. Chan, 
offered at the Naval Postgraduate School. The CALAHAN program was the 
final enotce since it provides for a graphical output of the frequency 
response, an output not available with ECAP. Presumably the engineer 
who is designing by optimization will either choose a program which he 
has used successfully, or he will write a program to suit his needs. 

1. A Linear Network Analysis Program 

The CALAHAN program is a general-purpose program designed for 

the analysis of linear electrical networks [4]. Input data to the 
program consists of the number of nodes in the circuit, the number of 
passive elements, the number of active elements, the input and output 
node numbers, and the type of output desired. A list of element values 
must be provided as well as a range of values of frequency (time) over 
which the frequents (transient) response is to be calculated. Outputs 
from the eroureerate the coefficients of the specified network function, 
the poles and zeros, frequency and/or transient responses. The program 


is designed so that the user need only provide the required data cards, 


to obtain the desired output. 


Ls; 


2. Modification of CALLAHAN for Use in the Optimization Program 


In order to incorporate CALAHAN into the optimization program, 
it was necessary to make some modifications to the original CALAHAN 
program. Before this was done, the original version was run a con- 
Siderable number of times to yield frequency responses of circuits 
for which the actual responses were known. From the closed-form 
expression of the voltage transfer function of the Butterworth filter 
[5], the theoretical frequency responses were obtained for various 
orders of this type of filter. Using values of the normalized 
Butterworth filters [6], frequency responses were calculated by 
CALAHAN for different orders of the filter. The responses calcu- 
lated by CALAHAN were almost exactly the same as the theoretical 
responses. The procedure was also repeated with the CMe che’ filter 
and similarly good results were obtained. 

Since the goal of the optimization is to determine a set of 
element values for a particular network configuration whose frequency 
response is to match a given response as closely as possible, only the 
portion of CALAHAN that calculates the frequency response is needed. 

The main program from the original CALAHAN was reduced until only the 
portions involving the frequency response remained. Several subroutines 
that are not essential to the calculation of the frequency response 


were removed. 


B. THE MINIMIZATION PROGRAM 
The minimization program used in conjunction with CALAHAN to form 
the optimization program is a direct search technique [7]. This 


category of minimization techniques requires only the calculation of 
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the value of the performance measure, the calculation of derivatives 
not being a requirement. A gradient technique used in the design of 
filters by optimization is the subject of the Naval Postgraduate School 
thesis written by Major Charles A. Henry, USMC. Results obtained using 
the two methods are discussed and compared in Chapter IV. 
1. Direct Search 

Direct search may be basically described as a sequential 
examination of trial solutions which involves the comparison of the 
trial solution with the "best'' solution obtained up to that time and 
a method for determining what the next trial solution will be [7]. 
Among the various types of problems which can be solved by direct 
search are solution of system of equations, curve-fitting problems, 
solution of integral equations, and minimizing (or maximizing) 
functions with or without constraints on the variables. The application 
of direct search methods to the solution of problems of the types 
mentioned above is basically the same regardless of the type of problem. 

A space of P points, representing the solution space, must be 
defined. There must be some means to determine that one point is 
"better" than another. Presumably there is a "best" solution P* in 
the solution eee Direct search is then accomplished in the following 


manner: A point B designated the first base point, is arbitrarily 


1? 
selected in the space. A second point, Py» is then selected and com- 
pared with By: Tif P, is "better" than By then P, becomes B,» the 
second base point. However if Py is not "better" than Bi» then By 
remains the base point. The process continues with each new point 


selected and compared with the current base point. The technique for 


selecting new trial points is determined by various conditions which 


7 


arise as a function of results of trials made. The‘technique to be 
used in the minimization program is pattern search. 


- 2, The Specific Technique--Pattern Search 


' Pattern search is a direct search technique for finding the 
minimum of a function F(p)of the variables p = (Py> Po> Pa> me 
The argument p is varied until a minimum value of F(p) is obtained. 

The successive values of p represent points in an N-dimensional space. 
The operation of the pattern-search routine will now be 
descriHed. First,“a few definitions willbe of aid in the eneuine 
discussion. The procedure of going from one point to another point 
is termed a move. If the value of F(p) decreases, then the move is a 
success; if the function F(p) does not decrease, then the move is a 
failure. patiern search makes two types of moves. The explore move 
is to acquire knowledge about the behavior of the function F(p). The 
second type of move is the pattern move which utilizes the information 
gained from the explore moves to accomplish the actual minimization of 
the function by moving in the direction of an established pattern. The 


~ 


point from which a pattern move is made is known as a base point. 
Basie a Biymeras pattern-search procedure is movement from base point to 
base point. 

The explore move provides the information which indicates a 
probable direction for a successful move. A pattern is thus estab- 
lished. The pattern move from a given base point duplicates the 
combined moves from a previous base point if the direction of the 
pattern is unchanged. This process continues as long as the moves 


are successful, the step lengths increasing in magnitude. The result 


of each pattern move then is either a success or a failure. If the 
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pattern move is a success, then a series of explore moves is carried out 
to see if the result can be further improved. 

Each explore move is carried out in the following manner: a 
single coordinate of the point is varied by either increasing or 
decreasing the coordinate by some fixed amount and seeing if the move 
is a success. If a success occurs, the new coordinate value is used; 
otherwise the old coordinate is retained. For each coordinate, these 
explore moves are made until the final point, as a result of all the 
explore moves, becomes the new base point. 

If, on the other hand, the pattern move is a failure, the search 
continues by retreating to the base point and starting over again with 
new explore moves until a new pattern is established. 

The Satterneéeareh technique can be better understood with the 
aid of a simple enaripler Figure II-l serves as an illustration of what 
has been discussed in the previous paragraphs. A two-dimensional para- 
meter space is shown with equal-cost contours represented by Fi» F; 


ee Fe; Where F, > F The argument of the function F is p = (Dy Py) 


k k+1° 


The point B, is selected as the first base point and explore moves are 


iL 


= = 


conducted from this point. First the Py coordinate is stepped in its 


“= 


positive and negative directions; a success is achieved when the step 
is negative. Next the P5 coordinate is tested and it is determined 
that a positive step yields a success. The explore move produces a 


new base point B The most probable direction of a success is in the 


yr 


direction of the line segment By >? therefore, the pattern is estab- 


lished and the pattern move results in TP,, a temporary point. Each 


leg 


pattern move is followed by a series of explore moves. If the result 


of the explore moves is a success, then the pattern move is termed a 
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success. The point resulting from the successful explore moves becomes 


the new base Sie If, however, the explore moves are failures, the 
function value at the temporary point is calculated and if this value 

is greater than the function value at the previous base point, the old 
base point becomes the new base point and explore moves are tried again. 


At TP, explore trials are made and a successful move is made to B 


] i 


which becomes the new base point. This indicates that the pattern move 


to TP, was a success. By the same line of reasoning, the pattern move 


to TP, is a success. The pattern move to TP, is a failure since all 


2 3 


explore moves from this point are failures and the value of the function 


at TP, is greater than the value at B,3 therefore By, becomes B the new 


3 


base point, and the explore moves are tried again. The region within 


Se 


mm. 


the Fy contour is enlarged by a factor of five and shown in Fig. II-2. 


The point ‘B 


6 is a successful explore but it should be noted that there 


is no change in the Po coordinate from B A change in the Po coordi- 


5° 
nate would yield a failure. The pattern move to TP, is a failure, so 


B, now becomes B. and explore moves are made. Perturbations of both 


6 7 

Py and Po in the original step size do not produce any successful 
explore moves. It is, therefore, necessary to reduce the step size 
by some fixed amount. The step reduction factor in this case is 0.2, 
which means that the original step size has now been reduced by a 
factor of five. Once again explore trials are made, now with the new 
step size, and a success is achieved at By: The pattern move to TP, 
is a failure, so By becomes Lys A successful explore move is achieved 


at Bio but the pattern move to TP, is a failure and Bio becomes Bia: 
This process of reducing the step size and then making the pattern moves 


continues until the difference between two consecutive steps is less than 
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some prescribed amount. If this criterion is a very small number then 
the step size will be sufficiently small to ensure that the minimum has 
been closely approximated. Care must be taken in the choice of both the 
step size and the step reduction factor. Too large a reduction factor 
will result in a slowdown of the search procedure. If an initial step 
size is too large, the minimum may be missed altogether. 

The direct search procedure described above is termed pattern 
search since the minimization is basically performed by the pattern 
moves. Although the explore moves provide some reduction, their main 
purpose is to provide information for the improvement of the pattern 
move. The pattern-search program used in the optimization program is a 
program written by R. ei dieyaraiga with some modifications to include con- 


straints on the independent variables. 


C. THE OPTIMIZATION PROGRAM--A COMBINATION 

In sections A and B the individual programs in the optimization 
program were discussed in some detail. A brief description was given 
of the modifications to CALAHAN to accommodate the particular problems 
to be considered. How are CALAHAN and DIRECT together to be imple- 
mented into one Broce to be used in the design of networks by optimi- 
zation? The answer to this question is the subject of this section. 

The basic type of filter design problem which will be solved by the 
optimization program is one in which a particular frequency response is 
given and the objective is to design a filter which approximates the 


response as Closely as possible. In the next chapter the exact problem 


1 ; 
Subroutine DIRECT, Naval Postgraduate School Computer Facility. 


23 


a” 


problem formulation and specific example problems will be discussed in 
detail, but the above problem description is adequate for a general . 
discussjion of,the optimization program. After the particular carcuit 
has been selected, a choice of initial element values must be made, the 
engineer's knowledge and experience playing a vital role in the choice. 
Other information which must be supplied to the program includes the 
ease the number of frequency points to be matched, the values of 
the desired frequency response at the points to be matched, the explicit 
constraints on the element values, the step size, the step reduction 
factor, and the termination criterion for the minimization. 

The initial element values serve as coordinates of the first base 
point for the pattern search routine, called DIRECT. An external 
function subprogram then calculates the value of the function to be 
minimized by DIRECT, The exact form of this function may differ for 
different problems, but in all cases it is a comparison between the 
actual frequency response and the desired response. This calculation 
is performed as part of the function subprogram utilizing the modified 
‘version of CALAHAN. Once the minimum has been determined, the element 
values producing the minimum are supplied to the analysis program and 


the actual frequency response is calculated. This process may be 


repeated until the overall design satisfies all of the requirements. 
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III. IMPLEMENTATION OF THE OPTIMIZATION PROGRAM 


The use of the optimization program is dictated by the requirements 
for the design. An optimization technique should be used only when 
classical eee methods and experimental methods are either impos- 
sible or Piteas tpi The purpose of this chapter is to discuss the use 
of the optimization program in circuit design. The first section of the 
chapter is a general discussion of the features of the program. In the 


concluding section several examples are given to illustrate the use of 


the program. 


A, PROGRAM FEATURES 
i The Input Data 
For input data, the optimization program requires a topological 
description of the network, a list of element values, a range of 
frequencies over which the desired and actual responses are to be 
matched, a description of the desired response, the number of varying 
and non-varying elements, and a list of the constraints on the varying 
elements. The following information required by DIRECT must also be 
included in the input data: the step size, the step reduction factor, 
the termination criterion, and the maximum allowable number of evalu- 
ations. Figure III-lis a flow chart showing the sequence and coding of 
the input data cards. 
2. The Output 
The output from the optimization program consists of two parts. 
The first part is a result of the minimization and includes the value 


of the function at convergence, and the optimum values of the variable 


2 





Card No. 1 Title 


Use all 80 columns as 


required for the title 


Card No. 2 Oircuit Data 


No. of Passive (R,L,C) Blements 


No. of Active Elements 
No. of Nodes 

1234567890 1,234567890) 234567890 

Pos. Input Node 
Neg. Input Node 
Pos. Output Bode 
Neg. Output Node 

FORMAT (7 (12, 1X) ) 












Card No. 3,4,...,M Passive Elements 
Node No. of Branch 










Type of Element (R,L,C) 






1234567 


— 
Element Value 


FORMAT (I2,1X,12,1X,41,1X,F10.0) 


Fig. III-1 Coding Flow Chart for Optimization Program 





26 





Next Card(s) Active Blements 
Node No. of Active Blement 
—— No. of Controlling Branch 
i eh 678 901234567890 


Mutual Inductance M 


Transconductance G a Value of G or M 


FORMAT (4(I12,1X),41,1X, F#0.0) 


Next 2 Cards Frequency Response Data 
Scale (1-Linear, 2-Logarithmic ) 
r Total No. Points or 
Col. 12345 Points/Decade 
FORMAT (1I1,1X,13) 
Low Prequency 
High Prequency 

1234567890 1 234567890 

PORMAT (2P10.0) 


Next Card(s) Desired Frequency Response 


FORMAT (F15.7) 


Fig. ili-l <centrnued) 





a7 


Next Card 


No. of Constant Elements : 
No. of Variable Elements 


Col./ 1234567890 
FORMAT (215) 


Next Card Parameters for Pattern Search 


Step Sise Step Reduction Pactor 
Col. / 12345678 9012345678 901 234567890 12345678 9012345 67890 


Termination Criterion 


Maximum No. of Evaluations 


FORMAT (3F15.7,15) 





Next Card(s) $Blement Constraints 


Upper Bound 
Lower Bound 


sare 1234567890 12345678901 234567890 
PORMAT (2715.7) 


Fig. III-1 (continued) 
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elements. The second part of the output is a result of the analysis 
program. With the optimum element values calculated by DIRECT, the 
frequency response is calculated. The output is in tabular form as well 
as in a graphical form. The circuit designer merely compares the values 
of the calculated response with those of the desired response. If the 
design requirements are satisfied, the element values calculated in the 
first part of the output are the element values of the design. 
3. Accuracy of the Optimization Program 
In all examples used in testing the program, the performance 


measure to be minimized was of the form, 
N n 
i ill [R, (£,) - R, (£,) | 


where J(p) is a function of the network elements p. Ra (f,) is the 
actual frequency response at the ve comparison point and Ry (f,) is 

the desired response at the same point of comparison. N is the total 
number of frequency points to be compared and n is Some even integer. 
Theoretically, the minimum of this performance measure is zero if a 
perfect match of frequency responses is achieved. In practice, however, 
a zero out put is rarely, if ever, achieved. The measure of accuracy is 
determined by the function value at exit from DIRECT; the smaller the 
function value, the closer the actual response approaches the desired 
response. 

The accuracy of the output is basically dependent upon the 
choice of the termination criterion for DIRECT. The pattern search 
ends when the aiferea ee between consecutive step sizes falls below 
this pre-selected termination criterion. A small criterion will result 


in a small function value, consequently a closer approximation to the 


Zo 


desired response. The program allows the user to specify the termination 
criterion as part of the input. Table III-1 shows a comparison of 
execution times, and function values, for a normalized fourth-order 


Butterworth filter, as a function of the step size, the step reduction 


factor, and the termination criterion. The performance measure used was 
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Z 
sp) = 5 [R, (£,) - R, CED]. 
i=] 


The function values for a termination criterion of io" differ by a 
factor of 100 from those for a termination criterion of 108s whereas 
the difference between function values for termination criteria 10 and 
10 ~ is insignificant. In this case there is no particular advantage in 
the choice of a termination criterion less than tee Since the function 
values only change slightly but the execution times are longer. A com- 
parison between the desired response, for the frequency range specified, 
and the largest and smallest function values is given in Table III-2. 
4. Execution Time 

The execution time for the program is dependent on several 
factors which will be discussed in this section. The initial choice 
of element values will certainly affect the execution time; if the 
initial guess is a poor choice the program may take an inordinate amount 
of time if it converges at ali to a minimum. Convergence to a minimum 
also may be quite slow for circuits with a large number of elements. 
The only solution to this problem is to choose a simpler circuit con- 
figuration which may yield a response within acceptable tolerances. In 
the pattern search, the execution time is a function of the termination 
criterion. The choice of the termination criterion is a compromise 


between speed and accuracy; one is sacrificed for the other. If more 
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Trial 


Step Red. 
Factor 


0225 


OF25 


Oil2 2 


0.125 


Ona25 


0225 


Uz 


Owz5 


OeZ> 


Omi Z5 


0. 125 


275 


ORZ® 


Oe 


OplZs 


0.12) 


Ome 


TABLE LII-1l 


Termination 
Criterion 
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Execution 
Time (Sec 


5 OES 
66.30 
70.01 
54.93 
7 Ons 
777. 
46.37 
70.90 
78.07 
49.09 
DiioZ 
63.03 
68.27 
87220 
90.89 
Sae22 
104.78 


110.14 


Function 


Value _x 10° 


203.67 
oe, 2291 
0. 236h2 
LOS 01 
0.11424 
0.11424 
FOG 79) 
OF 552 35 
0.54994 
60.625 
heel D3 
WiG23 
HG. / 3:0 
0.14581 
0.14581 
284.77 
Om 12187 


OMi21:3/ 


Desired 


Response 


- 0. 


- QQ, 


- 0 


1042320 


2204427 


4314420 
.7850979 
3305276 
1019602 
1032674 
.3047 100 
6547211 
0972899 
5844102 
0806382 
5623696 
0151248 
4307494 
8052081 
1370394 
4263366 
6740983 
8818219 


ROL 2536 


TABLE III-2 


trral’G 
Response 


= 0 


- 0 


= 


- Q, 


. 1032002 
72196893 
4310329 
7850114 
986067 15 
~ 1021585 
. 1033316 
3045549 
6543064 
.0966568 
mois 536172 
0797758 
5614929 
0142879 
4300060 
- 8045635 
wS'6'5509 
4259949 


6728692 


8817902 


FOSS 916 
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Trial F 
Res ponse 


=a 


- QO, 


=e 


- 1042283 
2204416 
.4314427 
Pvo5 1012 
- 3305340 
wl019697 
. LOS258k 
-3047056 
6547127 
10972862 
. 9844040 
0806456 
2623701 
| OS ISzy 
-4307604 
Po052015 
mis 70392 
-4263458 
6740875 


.8818054 


0512390 





accurate results are required then the execution time is necessarily 
longer. Table III-1 shows the effects of different step reduction 


~ 


factors and termination criteria. A further comparison of execution 
time as a function of the number of points compared is made for the 
normalized fourth-order Butterworth filter. The results of this com- 


parison are shown in Table III-3. 


TABLE III-3 


— 


No. Points Execution Time (Sec) Function Value 


50 : 147.06 0.8699953 x 10°° 
40 112.77 0.4037205 x 10’ 
30 83.93 0.3040103 x 10 °° 
20 (olde WmLVA We ee © 


B. DESIGN EXAMPLES 

To illustrate the use of the optimization program, several examples 
of filter 2, will be discussed in this section. In all of the 
examples, the desired frequency reSponse is in the form of a table of 
values. These values are to be matched as closely as possible by the 
circuit configuration selected. In general, design specifications are 
not quite as stringent as this. A more likely specification would be 
to design a maximally flat filter in a pass band whose cut-off 
frequencies are at fy and f, and with a dropoff of a specified number 


of db per octave; however, to illustrate the capability of the program, 


point-by-point comparisons will be made. 
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Example 1 


Problem: Find the optimum element values for the filter con- 
figuration shown in Fig. III-2, whose frequency response from 0.15Hz 
to 0.24Hz most closely approximates the peumerdar Butterworth response 


over the same range of frequencies. 


il 3 s, Constraints on element values 


O5= 1. < ie 





1 
1.0<C, < 2.9 
LO= 1,5 12 R= 1,0 
0.4<C, < 1.0 
Fig. @@i-2 «@aecuit for Example I Ora cs L, <C> 


Solution: 
Trial 1 Initial guess: L,=1.0, C,=2.0, mei) = Creare , L.=.9 
At exit from program: L,=1.29, C 


1 
Function value = .2435 x 107° 


=2.12, L,=1.19, C,=.888, L,=.161 


2 4 3 


Trial 2 Initial guess: L,=1.6, C 


f =2.0, L,=1.5, C,=.8, L.=.5 


a 3 bi. 


=1.5, L,=1.51, C,=.875, L.=.372 


At exit from program: Lj=1.7, C 5 
Function value = .6473 x 107! 


2 4 


Trial 3einitbiadeguesse , =le6queGa=2 60m Lael 55 eG .9, B=. 


1 2 3 4 5 
At exit from program: L,=1.54, Co=1./7, L,=1.38, C,=.895, Lo=.307 


Function value = .5150 x ou 


Trial 4 Initial guess: L,=1.6, C,=2.0, L =1.5, C,=.9, L-=.3 


=.903, L.=.253 


At exit from program: L,=1.43, C 5 


i 


=1.87, L,=1.29, C 


2 4, 


Function value =.1384 x 10. 
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Teal Seinatial guess: L,=1.6, C,=1.8, L, 


slrepta = Bye 


— Se C.=.9; L.=.4 
At exit from program: L)=1.54, C 207 


rs 


=,895, L 


2 4 5° 


Function value = .429 x 10. 


The optimum element values are those values calculated in trials 3 and 
5. Comparison of the trial frequency responses with the Butterworth 
response is shown in Table III-4. 

Discussion--In this problem only ten points were compared, if more 
accurate results are desired more points should be compared. The element 
values for trials 3 and 5 are very close to the values for the fifth 


order normalized Butterworth filter. 
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Example 2 


Problem: Design a filter which approximates the straight-line 
characteristic shown in Fig. III-4. 

Solution: Select the circuit configuration by determining the slope 
of the straight line after cutoff. The slope is approximately 24db per 
octave. Each 6db/octave represents one order of a low-pass filter; 
therefore the circuit to be used for the design is a fourth-order low- 


pass filter as sewn in Fig. ill-3. 





Fig. III-3 Circuit for Example 2 


Results: 


The first initial guess: L,=2.0, C,=2.0, L,=2.0, C,=2.0 


1 2 3 4 
At exit from program: L,=1.44, C,=1.62, L,=1.10, C,=0.379 


The second initial guess: L,=1.5, C,=1.5, L,=1.0, C,=0.5 


At exit from program: Lj=1.44, C,=1.63, L,=1.10, C,=0.381 


2 3 4 


A plot of the actual and desired responses is shown in Fig. III-4. 
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Gain (db) 


-10 


-15 


-20 


-25 


FREQ (Hz) 


\ 


\ Desired 


Actual 


Fig. III-4 Desired and Actual Responses for Example 2 
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Example 3 


Problem: Design a filter that has a Gaussian distribution response 
in the frequency range from OHz to 4Hz. 

Solution: The first step in the solution is to change the Gaussian 
response from a voltage ratio to db for use in the optimization program. 
Table III-5 contains the values for a 2l-point comparison. The response 
is plotted in Fig. III-5. 

The first trial design was a ninth-order low-pass filter. The 
resulting response is plotted in Fig. III-5 showing rather marked 
deviations from the desired response. At the lower frequencies the 
deviations are much greater. 

The second trial design was a modified fifth-order low-pass 
filter. The Pen Gh se is plotted in Fig. III-5. There is a slight 
improvement in the approximation; however the deviations at some points 
are quite large. 

Discussion: In this problem, only low-pass filter configurations 
were considered. Both design responses deviated considerably from aie: 
desired responses. This points out a limitation of the optimization 
program. The success of the optimization technique is dependent upon 
the circuit configuration selected. In this example, presumably there 
is a better circuit configuration which would approximate the desired 


response with less deviation. 
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TABLE III-5 


Desired Design 1 

Ered Gain Gain 
0. De Og 

Oy.2 - 0.174 0...3:89 
0.4 =~0),693 1824 
056 ale O8 L172 
0.8 sui Diewlel 9 =» 3.293 
LO - 4,341 saute, > Ol. 
ee =e 5 - 8.378 
1.4 SB o12 a eh lone 
b.6 ad ke -10.663 
L.3 -14.067 -17.770 
D0, -17.368 -22.048 
22 =? 1012 -23 .421 
2.4 -25.005 sk, Gules 
2b -29.345 -22..974 
a: -34.067 -36.294 
50 he) aera -44 ,084 
Cry -44 .437 = NS) 
3.4 -50.458 -54.899 
5.6 -56.478 SOTO 2 
3.8 -61.938 -62.697 
4.0 -70.458 -65.865 
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Design 2 


Gain 


Oz 


- l, 


296 


. 886 
000 
n269 
.687 
aes) 
sD 
150 
‘962 
a o2 
athe 
O28 
ral Ob 
7D 
194 
Jeo 
640 
ls) 
joe 
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Gain (db) 


=-10 


-20 


-30 


-40 


=50 


-60 


-/0 


— + Design 1 


FREQ (Hz) 


0. Peo 220 a0) 4.0 





Desired Response 





X Design 2 


Fig. III-5 Comparison of Two Designs with the 
Gaussian Response 
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Example 4 


Problem: Design a simple bandpass filter to match the desired 
frequency response of Table III-6. 

Solution: A simple third-order low-pass filter is transformed into 
a bandpass filter by frequency transformation. The resultant circuit is 


shown in Fig. III-6. 


* 


Fig. III-6 Bandpass Filter Design 


Results: 
The initial guess: L,=0.5, C,=1.2, C,=1.2, L,=0.5, L.=0.75, C.=0.75 
Exit from program: L,=0.278, C,=0.968, C,=1.07, L,=0.231, L.=0.512, C.=0.5 


Results are tabulated in Table III-6. 
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TABLE III-6 


Desired 
Gain 


-10.6043911 
- 7,.8007050 
abi 5 3960 
- 6, 1659341 
- 6,.0634375 
momo Oly 52 
- 6.0222807 
- 630207653 
=. 620205956 
- 6.0205870 
=" b.020583 2 
- 6,0205908 
- 6,0206118 
- 6.020/939 
- 6,0214853 
- 6.0233574 
- 6.0275412 
- 6.0356464 
- 6,0498857 
"650731249 
- 6,.1088524 
- 6.1611710 


- 6.2347078 
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Actual 
Gain 


-10.6046772 


7. 8000293 
6.5954628 
6.1866503 
6.0643120 
6.0309124 
6.0227900 
6.02 11134 
6.0207987 
6 ,0207443 
6.0207691 
6.0208607 
6. 0200257 
6. 0215528 
600220193 9 
6 .0242023 
6.0284853 
6.0366526 
6.0509090 
6.0740948 
6.1096964 
6.1618414 


6.255723 


TAB LE 


III-6 (continued) 


Desired 
Gain 


- 6, 


- 6, 


- 6, 


- 6 


= 


3344698 
4655190 


6326761 


-8401451 
.0910606 
oer e2252 
7200352 
1145258 
5414162 
0054874 
.5018768 
(0250272 


~ 5705452 
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Actual 
Gain 


.3346691 


-4654360 


6323280 


76395615 


.0902948 


. 3863 807 


a Zouoo2 


. 1138344 


-5409737 


0054045 


~ 5022497 


0262442 


5720444 





Example 5 


Problem: Determine the element values of a fourth-order low-pass 
filter whose frequency response approximates the response of a fourth- 
order Butterworth filter using: 

(a) ideal elements 
(b) inductances with nominal resistance of 0.01 ach 
(c) inductances with nominal resistance of 0.5 ohms 

Solution: The circuit selected is the same as in Fig. III-3 but 
there are series resistors with the inductances when non-ideal elements 
are considered. The initial guess for the elements is the same for all 
three situations. All parameters for DIRECT remain the same. The 
frequency range is from 0.1 Hz to 0.3 Hz, comparing 21 points. The 
results are shown in Table III-7. Figure III-7 is a comparison of the 
frequency responses for circuits with ideal and non-ideal elements. 

Discussion: For nominal resistances of 0.01 ohms the element values 
did not change much from the values of the ideal elements since the 
resistances are so small. When the resistance is of the same order of 
magnitude as the inductance then the final element values differ con- 
siderably from the ideal element values. Also, with non-ideal elements 
the frequency response as shown in Fig. III-7 is attenuated at the low- 


frequency end. 


45 


Gain (ab) 


-10 


= | 5 = 


-20 


FREQ (Hz) 
“2 


\ 
XN 


© Frequency Response for Circuit NN 
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Ideal Element Values 


Response of Ideal and Non-ideal Circuits 


TABLE III-/ 


Non-ideal Element Values 


R, = 0.01 Ro = 0.5 
Ly = 1.51 Ly = 1.11 
Cy = 1.59 C, me. 31 
L. = 1,09 L, = 1,53 
Cy = 0,386 Cy = 0.215 





IV. SUMMARY AND CONCLUSIONS 


The subject of computer-aided design by optimization techniques, 
although only one facet of computer-aided design, is in itself quite 
a diverse field. There is a large variety of optimization methods 
which can be effectively employed in network design. The main reason 
for using an optimization technique instead of a classical synthesis 
technique in circuit design is that classical techniques cannot satisfy 
all possible design specifications. A Dee on such as matching 
the response of a circuit to some desired response given by a table of 
values or a graph cannot be realized by classical techniques. Con- 
straints on circuit element values generally cannot be accommodated 
by classical methods. Such design specifications which cannot be 


realized by classical methods can often be satisfied by optimization 


techniques. 


A. SUMMARY 

Chapter I is an introductory chapter presenting a general discussion 
of computer-aided design and application of optimization techniques in 
computer-aided design. The three basic categories of optimization 
techniques are described and the general nature of the problem is 
presented. 

In Chapter II the optimization program is described. The optimi- 
zation program used is a combination of the linear network analysis 
program by Calahan and the pattern-search technique for minimization 


of a function of several variables. Modifications to the original 


analysis program were made in order to incorporate it into the 
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optimization program. Basically this was a matter of reducing the 
size of CALAHAN, since only the portion eeete nia’ to frequency 
response was required. The specific Weenee OF pattern search, DIRECT, 
in conjunction with the modified version of CALAHAN constitute the 
optimization program. 

The specific details regarding the implementation of the optimi- 
zation program are included in Chapter Iil. Ins@*euctions for coding 
of input data cards are shown as a coding RIOWCnaee cia RCI I Lol 
The factors affecting the accuracy of the program are shown by the 
data of Table III-1. A comparison of the accuracy of the program for 
the worst and best approximations over a series of trial runs is shown 


in Table III-1 and Table III-3. Five design examples are provided at 


the end of the chapter. 


B. CAPABILITIES AND LIMITATIONS OF THE PROGRAM 

For the designs attempted, results indicated that the optimization 
program is highly accurate and relatively fast. A comparative study 
between the gradient-projection method described in the Naval Post- 
graduate School thesis by Major C. A. Henry, and the pattern-search 
method was conducted to determine the relative accuracy and speed of 
the two methods. Examples 2, 4, and 5(a) in Chapter III were selected 
for the comparisons. The results are shown in Table IV-l. Very 
accurate results can be achieved, as shown by Example 4 in Chapter 
III. On the other hand, results may deviate considerably from what 
is desired, as illustrated in Example 3 in Chapter III. A high degree 
of accuracy can be achieved if the circuit configuration chosen is the 


proper one for the desired response. At present there is no known 
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optimization program that automatically alters the configuration of 


the network to yield an optimum solution. 


TABLE IV-1 
Function Execution 
Design Problem Method Value Teeter’) 
Seratemeet ye Gradient Projection 165 Sz 
; =%) 
PAPE -O#88r Gradient Projection 0.458x10 133 
Gradient Projection 0.564x1074 328 
Band Pass 
Pattern Search 0.220x107> 184 


One of the main limitations of the optimization program is that 
an excessive execution time is required for circuits with more than 
12 or 13 elements. The reason for this is that CALAHAN finds the tree 
for the network each time the elements are perturbed. This is not 
necessary since the circuit configuration remains the same throughout 
the optimization process; however no attempt was made to alter this. 
The total memory requirements for the program are approximately 
110 K bytes. This may or may not present a problem depending upon 


the computer system available to the circuit designer. 


C. FUTURE REFINEMENTS 


Possible areas in which the program may be improved or imple- 


mented are: 


(1) Modification of the tree-finding process so that the 


Eree temnound only once for each circuit, configuration. 
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(2) Use of the program to optimize active networks. 

(3) Development of a means to "grow'' elements; i.e. development 
of a technique that will change the circuit configuration. In this 
manner the circuit configuration as well as optimum element values 


would be calculated. 
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